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Method and Apparatus for Virtual Editing of Multimedia Presentations 



CLAIM OF PRIORITY 

[0001] This application is related to, and hereby claims the benefit, of provisional 
application serial 60/250,978 filed December 1, 2000 and is hereby incorporated by 
reference. 

FIELD OF THE INVENTION 

[0002] This invention relates generally to multimedia presentations and more 
specifically to methods and apparatuses for virtually editing the same. 

BACKGROUND OF THE INVENTION 

[0003] In most multimedia presentations available today there is at least some content 
that a viewer would prefer was not presented. A viewer may wish to avoid certain 
portions of a presentation for many reasons. For example, a viewer may wish to avoid 
portions of a movie containing violence or profanity. A viewer may wish to avoid 
presentation of politically or religiously objectionable portions of a news broadcast, or 
socially objectionable portions of a music video, for example. Or a viewer may simply 
wish to avoid portions of a multimedia presentation that are boring or uninteresting to the 
viewer. For example, many viewers of broadcast sporting events, such as football and 
baseball games, don't have time to watch the entire event at the exact time it is broadcast. 
In such cases, the viewer may wish to save time by viewing only the portions of interest 
in a broadcast, (i.e., action highlights, such as home run being hit or a football scoring 
drive or a brilliant defensive play). 
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[0004] Currently viewers have no way of separating such interesting portions of a 
presentation from the presentation without first viewing the complete presentation. In the 
case of sporting events, viewers may rely on sports summary shows for highlight replays, 
where a broadcaster edits the sports event and typically shows only a few seconds of each 
action sequence. Such edited presentations are often not sufficient to fully enjoy and 
appreciate the action of the event. In the case of other multimedia presentations, for 
example, news programs, concerts, etc., viewers may have no way of viewing only 
specified portions of a presentation. 

[0005] Viewers may record multimedia presentations such as sporting events, news 
reports, concerts, or other programs in their entirety for presentation at a later time. 
While this allows viewers to avoid unwanted portions of a presentation, the viewer must 
also work through, at the least fast-forwarding through, all the uninteresting portions of 
the presentation. 
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SUMMARY OF THE INVENTION 

[0006] A method and apparatus for viewing desired portions of a multimedia 
presentation is disclosed. Desired portions of a multimedia presentation are determined. 
An annotation file is then created. The annotation file contains pointers corresponding to 
the desired portions of the multimedia presentation. When the multimedia presentation is 
viewed, the annotation file may be used to cause a viewing device to present only the 
desired portions of the multimedia presentation. 

[0007] Other features and advantages of the present invention will be apparent from 
the accompanying drawings, and from the detailed description, that follows below. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] The present invention is illustrated by way of example, and not limitation, by 
the figures of the accompanying drawings in which like references indicate similar 
elements and in which: 

[0009] Figure 1 is a process flow diagram in accordance with one embodiment of the 
present invention; 

[0010] Figure 2 is a system block diagram of a broadcast system in accordance with 
one embodiment of the present invention; and 

[0011] Figure 3 illustrates an exemplary recorded program file and a corresponding 
annotation file in accordance with one embodiment of the present invention. 
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DETAILED DESCRIPTION 

[0012] An embodiment of the method of the present invention allows a viewer of a 
multimedia presentation to view only desired portions of a presentation and to avoid 
undesired portions. In one embodiment an annotation file is created containing 
identification pointers that identify desired portion of a presentation. Annotation 
management software may use the identification pointers to cause a display device to 
display only desired portions of the presentation. 

[0013] In the following detailed description of the present invention, numerous 
specific details are set forth in order to provide a thorough understanding of the present 
invention. However, it will be apparent to one skilled in the art that the present invention 
may be practiced without these specific details. In some instances, well-known structures 
and devices are shown in block diagram form, rather than in detail, in order to avoid 
obscuring the present invention. 

[0014] Figure 1 is a process flow diagram in accordance with one embodiment of the 
present invention. The process 100, shown in Figure 1, begins with operation 105 in 
which a recorded program file of a presentation is created. A recorded program file may 
be created for any type of multimedia presentation or may be created from a live event 
such as a broadcast football game. A recorded program file may be created on a viewer's 
set-top box and stored on the set-top box hard drive. 

[0015] At operation 110 desired portions of the presentation are specified. The 
specification operation may be effected in any number of ways and based upon many 
different criterion and combinations thereof. For example, an editor may view an hours 
long sporting event and may personally determine the most interesting 15 minutes of the 
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presentation. Alternatively, or in addition, predetermined criteria may be applied. For 
example, a routine determination that any unrelated aspects of a sports presentation, such 
as intermission entertainment, are not desired may be implemented. The specification of 
desired portions may be made based upon individual preferences provided by the viewer. 
For example, a viewer may determine that only portions of a news program relating to 
international events are desired. Many different parameters may be used by themselves 
or in combination to allow such specification. This may include but is not limited to 
cities, clubs, sports genres, closed caption, activities, score indications, audio recognition, 
video recognition, text, Internet data, other interactive television data, etc. 

[0016] In one embodiment the specification operation for a given presentation may 
be accomplished by a person deemed knowledgeable in the area to which the presentation 
pertains. For example, a sport star may specify the desired portions of a sports 
presentation. 

[0017] At operation 1 15 an annotation file is created with pointers set corresponding 
to the specified portions of the presentation. The pointers may be implemented as pairs 
to indicate a desired portion of the presentation. The annotation file may contain 
additional information such as a header to identify the program file or presentation to 
which the annotation file pertains. 

[0018] In one embodiment, the annotation file may also contain information about the 
specified portions of the presentation or the remaining portions of the presentation. For 
example, the annotation file may present information indicating the time length of 
unspecified portions or a synopsis of the unspecified portions. Alternatively, or in 
addition, the annotation file may present information describing a specified portion prior 
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to the specified portion being displayed. For example, if the specified portion of a 
baseball game includes a batter hitting a home run, the annotation file may provide the 
viewer with such information as the batter's name, the inning, the number of outs, the 
score, and the batter's previous performance (e.g., two strike outs which may have 
occurred in non-specified portions of the presentation). Such information may be 
presented prior to, or concurrent with, the specified portion of the presentation. In some 
cases, this may also include multiple parallel events, recorded at approximately the same 
time. 

[0019] At operation 120 the annotation file and the recorded program file are then 
accessed by a display device so that only the specified portions of the presentation are 
displayed. For example, the viewer's set-top box may contain software that controls how 
the recorded program file is presented. Alternatively, the viewer may subscribe to a 
service that controls the viewer's display device in real time. 

[0020] The operation of creating an annotation file and/or the operation of accessing 
the annotation file and the recorded program file in accordance with the present invention 
may be implemented by hardware and/or software contained within the viewer's set-top 
box. For example, a set-top box may include one or more processors that can execute 
code or instructions stored within a machine-readable medium that may also be included 
within the set-top box. 

[0021] The machine-readable medium may include a mechanism that provides (i.e., 
stores and/or transmits) information in a form readable by a machine such as computer or 
digital processing device. For example, a machine-readable medium may include a read 
only memory (ROM), random access memory (RAM), magnetic disk storage media, 
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optical storage media, flash memory devices. The code or instructions may be 
represented by carrier-wave signals, infrared signals, digital signals, and by other like 
signals. 

[0022] Annotation files may be available separately from the presentations to which 
they pertain. For example, a viewer may obtain a DVD video movie and subsequently 
create or purchase an annotation file pertaining to the movie. An individual viewer may 
complete some or all of the specification operation. For example, a viewer may 
determine that only non-violent portions of the movie are desired. The viewer may then 
create an annotation file that specifies only non-violent portions of the movie. 

[0023] An annotation file, in accordance with one embodiment of the present 
invention, may be produced by the broadcaster of the multimedia presentation. 
Annotation files may be broadcast or e-mailed to the viewer in real time or after the 
presentation. Annotation files may be created as an event is being broadcast. For 
example a sportscaster could push a button when he judges that the sporting event he is 
broadcasting has become interesting and release the button when the interesting portion is 
complete. The sportscaster' s actions could then be converted into software pointers of an 
annotation file. The annotation file could be used to affect the broadcast in real time or 
used by a viewer subsequently. 

[0024] Figure 2 describes in detail how an embodiment of the present invention may 
be applied to a broadcast presentation. However, as noted above the invention is not 
restricted to broadcast events and may be applied to a multimedia presentation of any 
format. Figure 2 is a system block diagram of a broadcast system in accordance with 
one embodiment of the present invention. Those skilled in the art will recognize that the 
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invention is not limited to embodiments illustrated by Figure 2. For example, the 
satellite broadcast system may be replaced with any of various terrestrial broadcast 
systems, including but not limited to systems such as analog or digital cable, digital 
subscriber line (DSL), aerial, wireless cable, fiber, local multi-channel distribution 
systems (LMDS), etc., all of which are well-known in the art. 

[0025] The broadcast system 200, shown in Figure 2, includes a head end 201 having 
a satellite dish 202. Head end 201 transmits a presentation via a signal 221 from satellite 
dish 202 to satellite 203. Satellite 203 transmits the presentation via a signal 222 to a 
viewer's satellite receiver dish 210, which is connected to a set-top box 211. 

[0026] Set-top box 21 1 contains a hard disk 212 that the viewer may use to record the 
presentation as a recorded program file. The set-top box 211 also contains annotation 
management software 214 in accordance with the present invention. 

[0027] The viewer may typically view on a television 213 a live event or a recorded 
event played from hard disk 212 through set-top box 21 1 . The set-top box 21 1 may also 
have a back-channel connection, for example, via satellite, cable network, or public 
switched telephone network (PSTN) 230, through telephone connection 223, typically 
sharing the viewer's home phone. 

[0028] The back-channel connection may also be established through connection 225 
to a server 243, which may, for example, receive the same broadcast as the viewer via a 
satellite dish 240 and a set-top box 241. The broadcast presentation may be recorded on 
a hard disk 244 connected to server 243. A workstation 242, connected to the server 243, 
may be used by an editor, not shown, to view the broadcast. The editor may then specify 
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desired portions of the presentation and create an annotation file including pointers 
corresponding to the desired portions of the presentation. 

[0029] The annotation file may then be downloaded from the server 243, through a 
back-channel connection, to Set-top box 211. 

[0030] In one embodiment, the program provider or broadcaster may operate server 
243. In such cases, a link 226 may allow a direct connection via a LAN between server 
243 and head end 201. The annotation happens in server 243 under use of workstation 

242. In one embodiment the annotation file may then be transmitted back over link 226 
and broadcast over a data broadcast facility, for example, embedded in an MPEG file. In 
an alternative embodiment, the annotation file may be transmitted via separate dedicated 
data channels, to be received by set-top box 211. For example, the annotation file may be 
sent via link 225 and PSTN, Internet, or other transmission links to set-top box 211. 

[0031] In an alternative embodiment, the server 243 is operated independently. 
Presentations may be received using satellite 203 and link 224, and annotated in server 

243, by workstation 242. The annotation file may then be sent via link 225 and PSTN, 
Internet, or other transmission link to set-top box 211. In one embodiment, the 
annotation content may be sent over link 226, and broadcast over a data broadcast 
facility, for example, embedded in an MPEG file. In an alternative embodiment the 
annotation file may be transmitted via separate dedicated data channels, to be received by 
set-top box 211 under a separate data broadcast agreement. 

[0032] Figure 3 illustrates an exemplary recorded program file and a corresponding 
annotation file in accordance with one embodiment of the present invention. The 
recorded program file 300, shown in Figure 3, may be, for example, an MPEG2 file. 
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Alternatively, recorded program file 300 may be in any type of video or audio recording 
file format known in the art. Portions of recorded program file 300, 300a and 300b, 
indicate desired portions of a presentation. The corresponding annotation file 310, shown 
in Figure 3, includes a series of pointers, 311a through 31 In, which correspond to 
desired portions of a presentation in program file 300. Some of the pointers may be 
paired pointers, such as 311a and 311b, that can mark a spot and scope of a segment of 
interest, as do similarly paired pointers 31 lc and 31 Id and other similar pairs. A single 
pointer 31 In points to a specific singularity or event, for example, the beginning of a 
particular activity. 

[0033] In one embodiment, annotation file 3 10 may include an ID header 312 that 
allows the annotation file to identify the recorded program file to which it pertains. 

[0034] When the viewer plays the annotation file and recorded program file, the 
annotation management software 214 reads the annotation file and causes a display 
device to display only the desired portions of the multimedia presentation (i.e., portions 
300a and portion 300b of program file 300). Portions of program file 300 not specified 
as desired are not presented. For example, the annotation management software may 
cause a display device to skip the unspecified portions of program file 300. Therefore, 
the viewer may be presented only the portions determined by the annotation file. A user 
interface (not shown) may also be included. The user interface may use dedicated or 
programmable buttons to navigate. In one embodiment, the user interface may be 
controlled by, and or viewed on, a computer or internet appliance using standard PC -type 
controls. Furthermore, commands may be displayed on the screen and called upon with 
pointer devices or navigational keys. In an alternative embodiment, the whole event is 
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recorded and other scenes may be viewed by using normal recorded media navigation, 
rather than special keys. The same are used within the selected scenes. This also applies 
for cases of partial recordings. 

[0035] Many variations may be made without departing from the spirit of the 
invention, which allows viewers to view only desired portions of a presentation. 
Annotation files specifying desired portions of multimedia presentations may be offered 
as a subscription service separately from the actual programming or the annotation files 
may be combined with the programming as an enhancement of the broadcasting service. 
Alternatively, annotation files may be created by individual viewers or independent 
producers. 

[0036] In the foregoing specification, the invention has been described with reference 
to specific exemplary embodiments thereof. It will, however, be evident that various 
modifications and changes may be made thereto without departing from the broader spirit 
and scope of the invention as set forth in the appended claims. The specification and 
drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive 
sense. 
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